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ABSTRACT 


A maximum entropy (disorder) principle is used to determine the velocity distribu- 
tion functions in a quiescent plasma (case 1), a current-carrying plasma (case 2), and a 
viscous plasma (case 3). The Saha equation (at the electron temperature) holds for case 1. 
and modified Saha equations hold for cases 2 and 3. The modification in case 2 is 
important only in situations where the directed energy of the electrons is a substantial 
fraction of the total energy. The results of case 3 are presented in a general form and 
need simplification before they can be applied to a specific situation. 
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THERMODYNAMIC STUDY OF PLASMAS USING THE 
PRINCIPLE OF MAXIMUM ENTROPY 
by Norbert Stankiewicz 
Lewis Research Center 

SUMMARY 

The information theory idea of maximum entropy (disorder) is used to determine the 
most probable distribution functions of a species in a quiescent plasma (case 1), a 
current-carrying plasma (case 2), and a viscous plasma (case 3). 

The Saha equation (at the electron temperature) holds for case 1; a modified Saha 
equation, which is dependent on the current density, holds for case 2; and a result, which 
is dependent on the off-diagonal elements of the pressure tensor, is obtained for case 3. 

The modification in case 2 is important only in situations where the directed energy 
of the electrons is a substantial fraction of the total energy (i. e. , electron diffusion 
Mach numbers, ~1). 

The results of case 3 are presented in a general form and need simplification before 
they can be applied to a specific situation. This case, however, is illustrative of the 
method presented herein and of its possible extension. 

INTRODUCTION 


The properties of a plasma can be expressed in terms of averages over the distri- 
bution function of its constituent species. Unfortunately these distribution functions are 
rarely either directly measurable or known beforehand. In some instances, the maxi- 
mization of entropy offers a means by which these distribution functions can be deduced 
if certain constraints on the plasma are given. This report explores the application of 
the maximum entropy principle to various plasma states. In particular, the maximum 
entropy principle is applied to nonequilibrium systems. 

Related studies include a paper by Holway (ref. 1), which contains a discussion of 
an elliptical probability function derivable from a maximum entropy principle. This 
function is used to construct a kinetic collision model; the Lagrange multipliers are 



identified in terms of the expansion coefficients of the distribution function (Chapman- 
Enskog expansion). 

Kogan (ref. 2) investigates the relation between the most probable distribution func- 
tion and the moments of the Boltzmann equation. The most probable distribution function 
is found by ma xim izing the entropy with the moments as constraints. His approach is 
similar to Holway's in that he compares the most probable distribution function with the 
Chapman-Enskog expanded distribution function. 

A paper by Potapov (ref. 3) on the thermodynamics of a multispecie plasma with 
internal degrees of freedom is also of interest. He uses equilibrium thermodynamics to 
describe situations in which some species and degrees of freedom are not at the same 
temperature. His results, however, do not agree with the kinetic two -temperature 
results found in studies such as those of Bates, et al. (ref. 4). 

In constrast to the previously cited work, this report is concerned with the appli- 
cation of the maximum entropy principle to systems having variables other than those 
found in the usual thermodynamic system. 

According to information theory (see Jaynes, ref. 5), the most probable state of a 
statistical system is one in which the disorder is a maximum consistent with the given 
information about the system. (In the thermodynamic application of information theory, 
the equivalence of entropy and disorder is assumed. ) Any measurement on the system or 
information about the system can only subtract from the total disorder. The information 
plays the role of a state function in the thermodynamic system and serves to constrain the 
system. 

Information theory is equally applicable to equilibrium or nonequilibrium conditions. 
Equilibrium in the conventional sense becomes not a general result of the maximization 
of entropy, or disorder, but a result depending on specific constraints. The papers by 
Tribus (ref. 6) contain interesting arguments that support this idea. 

The three cases presented for which the idea of maximum entropy was used are the 
following: 

(1) Case 1: quiescent plasma 

(2) Case 2: current-carrying plasma 

(3) Case 3: viscous plasma 

Case 1 is presented to illustrate the maximum entropy approach. The important 
point is that the analysis yields the conventional or accepted result for a simple case. 
Thus, the analysis gains credibility for application to more complex cases. 
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A determinant defined in eq. (45) 
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electron acoustic velocity (defined following eq. (40)) 

"Hi 

energy of j state as measured from continuum 
energy of ground state as measured from continuum 
electronic charge 

density in phase space (six dimensional) 
dimensionless distribution function 
Planck's constant 

current density (defined in eq. (32)) 

Boltzmann constant 

electron diffusion Mach number (defined following eq. (40)) 
mass of electron, ion, and neutral atom (m- = m N ) 
number density 

number density of nuclei (nQ = n^ + n^) 

linear momentum density 

entropy density of system (defined in eq. (1)) 

temperature 

stress energy density (defined in eq. (41)) 

energy density defined in eq. (41)) 

fraction ionization 

partition function of electron states of neutrals 
function defined in eq. (47) 

Lagrange multipliers conjugate to stress energy densities introduced in 
eq. (42) 

IL 

energy of j state 

Lagrange multiplier conjugate to energy density (reciprocal tempera- 
tures) 

Lagrange multiplier conjugate to momentum density 
velocity with respect to center of mass 
dimensionless current (defined following eq. (36)) 
function defined in eq. (46) 
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Zl Lagrange multiplier conjugate to number density 
oj degeneracy 

Subscripts: 

e electron 

I internal energy 

i ion 

j j th state 

N neutral 

Mathematical notation: 
variation of 

shorthand for the three velocity coordinates d^ d£ 2 
average value 
vector symbol 
dyadic symbol 
absolute value 



ANALYSIS 


For the purposes of this report, the definition of the entropy density is 


S = 



f(ln f - 1) d 3 £ 


( 1 ) 


where u> is the degeneracy (o> = 2 for electrons), m is the particle mass, h is Planck's 

O 

constant, d £ is shorthand for the three velocity coordinates d^, d£ 2 , and d^, and f 
is the dimensionless distribution function. 

O 

The factor u>(m/h) arises from the correspondence principle (see Hill, ref. 7, 
p. 80) in passing to the classical limit (for free particles in a box) from the discrete to 
the continuous distribution function. 

The relation between the distribution function f and the density F in phase 
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space (six-dimensional) is given by 


F = 



( 2 ) 


Q 

The maximum density in phase space is cj(m/h) for the completely degenerate gas, for 
which case f = 1. The entropy, as given in equation (1), has a maximum at f = 1. 

Taking a variation of equation (1) gives 


or 



5f In f d 3 £ = 0 


f = 1 

This entropy maximum is taken to be the state of greatest disorder, that is, the com- 
pletely chaotic condition. 

Grad (ref. 8) points out that a given system has many entropies depending on 
those properties that the observer wishes to study. Once the system and the relevant 
measurements are defined, any quarrel between two observers over the proper choice of 
entropy implies that they are interested in different phenomena. 

The system under consideration in this study consists of a gas mixture of electrons, 
ions, and neutral atoms. (The neutrals are in various levels of excitation. ) A series of 
measurements with respect to the system center of mass are assumed to yield a know- 
ledge of various moments of the distribution function of each species. Moreover, it is 
assumed that an entropy function of the form given in equation (1) can be written for each 
species. 

The entropy density of each species is maximized subject to the imposed constraints 
(i. e. , the moments), the constraints are introduced by the method of Lagrange's 
undetermined multipliers. This introduction yields the most probable distribution for 
each species in terms of the undetermined multipliers. Since there is one undetermined 
multiplier for each constraint, the equations of constraint can be used in principle to 
determine the Lagrange multipliers. The distribution function of each species is then 
uniquely determined in terms of the assumed measurable information. 

The thermodynamics of the study begins when the relations between the Lagrange 
multipliers of the various species are investigated. Either by hypothesizing or by 
reviewing the previous measurements, one can conclude, for example, that the system 
is charge neutral, that at each station the sum of the ion and the neutral densities is a 
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constant, or that thermal equilibrium exists between free and bound electrons. This 
information, which is a subset of the measurements that led to the choice of constraints, 
is called the auxiliary information. The auxiliary equations are based on the usual 
plasma models, and the final results are limited to the accuracy of this model. The 
auxiliary equations, however, do not limit the validity of the maximum entropy viewpoint. 
They can be replaced by more accurate expressions with no alteration in the choice of 
constraints. 


Analysis of Case 1: Quiescent Plasma 

For the analysis of a quiescent plasma, a series of measurements with respect to 
the system center of mass is assumed. Through these measurements the following 
moments can be inferred: 

Number densities: 



Kinetic energy densities: 





u i 


1 

2 


m i n i 




(3a) 


(3b) 


(3c) 


(4a) 


(4b) 
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(4c) 


U N - \ m N n N ^n) " "j f f j m N^N d3 %) 


Internal energy density: 


-i*E ■*-£"*(?) /‘j 

J j 


d ^N 


(4d) 


Equating the moments (eqs. (3) and (4)) to their measured values gives the set of con- 
straint equations. 

The entropy equations for the species are (from eq. (1)) 


S 


■W 


( e (ln f e - 1) d->| ( 


(5a) 


S i = -"(v) / ‘ i(ln f ‘ ' 11 d3| ‘ 


(5b) 


s n = ■ X "'(ir) / - i)c,3 «n 


(5c) 


and the variational equations are 


6S - S3 6n - X 6u =0 
e e e e e 


6S^ - Oj6n^ - X^6u^ = 0 


6S N ' °N 6n N " X N 6u N ' x I 6u I = 0 


(6a) 

(6b) 

(6c) 


where S2’s and X’s are the Lagrange multipliers. 
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Substituting equations (3), (4), and (5) into equations (6) gives 


■<- 


if)’ / *•(' 


In f + + A A = 0 

e e e 2 e^e/ s e 


(7a) 


/m \ 3 

“i (y) / 


(7b) 


Wj (ir) f 6fj l 111 f j + + Xn 2 mN ^ + X][e j) d3 ^ N “ 0 


(7c) 


Because the variations are arbitrary, 


f e = e 


-fi e -A e 1/2 m e ^ 


(8a) 


-n r A. 1/2 m.£T 


f i ~ e 


_n N' A N 1//2 m N%' X I e j 
fj = e J 


(8b) 

(8c) 


Substituting equations (8) into equations (3) gives the number densities 


27rm e\ 3//2 _S2 e 
n e = 2( f-\ e 


(9a) 


277 m. \ 3 / 2 -ft. 

n i = W il 6 


„" X I e j / 2?7m N q -J2 N 

W — r* 

W h 


(9b) 


(9c) 
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The zero of energy for the bound states is taken as the zero of kinetic energy, so that 
the levels ej are negative (e^ = -E^) in this frame of reference. Thus, 


n N = 



n _ / 27rm N\ 3//2 e ~°N +X I E Q 

wv 


Z(X T ) 


( 10 ) 


where 


\ ' - Xj(Eq-E.) 

z(x i )H Z^“j e 


( 11 ) 


is the partition function of the bound states, and for moderate temperatures its value is 
the ground state degeneracy coq. 


Because 


at. 


ax. 


= im | 2 f 
2 e s e e 


the energy densities can be written as 



n 

e e 




From equations (4) and (9), 




(12) 


(13) 


(14a) 


X. 




u i 


n i 


(14b) 



2 

3 n N 


(14c) 
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Equations (14) allow the identification of the A’s as reciprocal temperatures 1/kT 
(see ter Harr, ref. 9, p. 3). It is assumed that Aj is also a reciprocal temperature. 
Combining equations (8) and (5) yields 

S e = (fi e + l)n e + X e u e = S e (n e , u 0 ) (15a) 

S i = (fi. + l)m + A i u i = S.^,^) (15b) 

= (^jq- + l) n N + ^N U N + ^I U I = U N’ U I^ (l^ c ) 

The Ci's and X’s are functions of the n's and u's because of the equations of con- 
straint. 

It is easily verified that 



An arbitrary change in the system entropy is given by 

dS = d(S e + S i + S N ) - « e dn e + Oj dm + % dn N + A g du g + A. d^ + A N du N + Aj d U][ 

(17) 

The au xilia ry equations relating the densities of the various species are assumed to be a 
charge neutrality 


n = n. 
e i 


(18a) 
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and a constant number density of nuclei 


n i + n N = n o . ( 18b ) 

The relaxation time of the free and bound electron subsystem is much shorter than 
that between the heavy species and the electrons. Thus, in a plasma a metastable equi- 
librium may exist, which leads to the two -temperature model (see Kerrebrock, ref. 10). 
Because of these inherent relaxation times of the system, the following auxiliary equa- 
tions relating the changes in the energy densities of the various species are reasonable: 


du„ = -du, 
e 1 

(19a) 

du A = -du N 

(19b) 


Because the system entropy is also a maximum, dS must vanish, and equation (17), 
with substitutions from equations (18) and (19), becomes 

(fi e + - S2 n ) dn 0 + (\ g - Xj) du e + (Xj - X N ) du A = 0 (20) 


Since dn , du , and du. are arbitrary nontrivial changes, it follows that 

6 G X 



(21a) 

x e = X I 

(21b) 

Xi = x N 

(21c) 

When equations (9a) and (b) and equation (10) are solved for the O's, 
becomes 

equation (21a) 

n 0X 2 _n e n._ 2 Wi /27rm\ 3 / 2 ^-X e E 0 

(22) 

!-x n N Z < x e>\x e h 2 / 



where equations (21b) and (21c) have been used in simplifying the relation, and the frac- 
tion ionization is x = m/ n^. This equation is the Saha relation as used in the two- 
temperature plasma model (ref. 10) in which the electron temperature is elevated over 
the gas temperature. 
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Analysis of Case 2: Current-Carrying Plasma 


For the ana lysis of a current-carrying plasma, the measurements of the system are 
assumed to indicate that diffusion of the three species with respect to the center of mass 
is occurring. Thus, in addition to the number and energy densities (eqs. (3) and (4)), the 
following moments are present: 


Pe * n e ra e (*e) = 2 (^) f f e m e«e d «e 
/ v /m.\ 3 r 

Pi , n.m. j J V d^ 



(23a) 


(23b) 


(23c) 


The equations of constraint now include these moments set equal, to their measured 
values. The variational equations are then 


6S e - n e 6n e " ^e * 5 P e “ X e 6u e = 0 

(24a) 

- ju. • 5pj - AjSuj = 0 

(24b) 

6Sj^ - • 5p^ - - AjSUj = 0 

(24c) 


which yield 

f e = e 

1/2 m ^ 3 

f i = e 

_ m N ^ N -X N 1/2 m N ^-Ajej 

— e 


(25a) 

(25b) 

(25c) 
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These equations can be shown to represent Maxwellian distributions for each species in 
its own center -of -mass frame of reference. The corresponding number densities are 


2Trm e \ 3//2 -O +(m / 2 )(m^/x ) 

Js) 6 


n i 



-n i +(m i /2 )(M?/X i ) 
e 


_ ^i e i / ^ 7rm N \ ! -S2^-+(mj 1 j/2)(Mj^/Xj N j) 

n, = w-e J ( \ e 

3 ] W ) 


n 


N _ 





Z(X T ) 


(26a) 


(26b) 


(26c) 


(26d) 


where Z(Xj) is the partition function defined in equation (11). 
Equations (23) yield 



and the energy density equations (see eq. (4)) yield 


(27a) 


(27b) 


(27c) 
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1 


(28a) 


m. 


X 


e 


3 



1 



X i 


3 




(28b) 


(28c) 


Thus the X's are again measures of the mean random energy and can be identified as 
reciprocal temperatures (1/kT) (see e.g. ter Haar, ref. 9, p. 17). Again it is assumed 
that Xj is also a reciprocal temperature of the bound states. 

The equations for the entropy of each species for the current-carrying case become 


S = (S2 + l)n + ju • p„ + Xu 
e e 7 e e ee 

(29a) 

Sj = (a + l)n. + • p t + X i u i 

(29b) 

S N = ( n N + X ) n N + ' % + X N U N + X I U I 

(29c) 


where the O's, X's, and M's are functions of the n's, u's, and p's through the equa- 
tions of constraint. As in case 1, it can be shown that 




grad S = u 
& p e e K e 


and similar identities for the other species. An arbitrary change in the system entropy 


S - S e + S i + S N 
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is then 


dS = dn e + Oj dnj + fi N dn N + ii q - dp A + Mj • dpj + m n • dp N 

+ X e du e + X i du t + A n du N + Aj dUj (30) 


The auxiliary equations for case 2 are assumed to be the same as those for case 1 
(see eqs. (18) and (19)). In addition, from the definition of the center -of -mass velocity, 
it follows that 


Pe + Pi + PN = 0 


(31) 


Because of the diffusion among species, charges will be transported and cause a current 
density 


J = el 


'Pi P e 


\m, in 
\ i e/ 


(32) 


Note that the electric field causing the diffusion of charges has been tacitly assumed. Any 
effect of the electric field other than the diffusion of charges is disregarded. 

With the auxiliary equations substituted, equation (30) (for a constant current density) 
becomes 


(m u + m. ja. - m-^jiUj) _ 

(fig + fi. - O n ) dn e + 6 i-i — dp e + (A e - Aj) du e + (A. - A N ) d Ujl = 0 


m. 


(33) 


from which it is concluded that 


+ fij - fij^ 

m e M e + = m N M N 

x e = X I 


(34a) 

(34b) 

(34c) 

(34d) 
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Equations (34) and (26) give the equivalent of the Saha equation for the flowing system 


as 


n e n i x \ 


n 


N 


(1-x) 


2a) i e’ XeE °/27rm \ 3/2 


T 2 /x 2 


(35) 


where 


T 2_m e M 2 m. Ml 2 m N ^N 


2X, 


2X i 


2X 


N 


(36) 


The fraction ionization is 


and the dimensionless current is 


x = 


n. 

l 


n, 


/ m e x e \ 1/2 


JI1 


en 


0 


Equations (31), (32), and (34b) can be used to write equation (36) as 

m. 


T 2 m e X e J ‘ 


m P K — e 

1 + (1 - 2x) — - — + 2x 


m N X N 


m 


x 2 2e 2 n 2 


ni X a m, 
l + (l_x)— — + x 


m N X N 


m 


N 


(37) 


Because of the mass difference between the electrons and the heavy species, 
equation (37) reduces to 



m A J 
e e 

,22 
2e n e 


(38) 
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Case 2 can be compared with case 1 if equation (35) is combined with the Saha equa- 
tion given in equation (22) (with the subscript s denoting Saha added). Thus, 


^2 (1 - x s ) ^ g T 2 /x 2 

x 2 - x ) " 
x s 


(39) 


Equation (38) can be written in terms of the electron diffusion velocity and Mach 
number as 


x 2 2 V V 6 e 


(40) 


where 



and the electron acoustic velocity is 


C 


e 



Analysis of Case 3: Viscous Plasma 

A viscous fluid is characterized as one having a nondiagonal pressure tensor. For 
the case under consideration, the relevant constraints are the number densities (eqs. (3)), 
the momentum densities (eqs. (23)), the internal energy density of the bound states 
(eq. (4d)), and the stress energy densities defined in the following equations: 

u e = ~ e m e (? e ? e ) = 2 / i e mJJ e djS (41a) 

Uj = f d{* (41b) 
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U N - n N m N (? N ? N ) = \ 



f j m N%f% d ^N 


The variational equations are 


A A 


6S q - fi Sn - ji • 6p - r * • 6U =0 ' « 

e e e e r e e e 


SS i - 0.5^ - i± i - 6p i - I\ • • SUj = 0 

A A 

SSj^- - ~ Mjg- ' 6Pj^ - - ^I^ U J = ® 


The distribution functions are 


li 


f e = e 


V» 1 e' m e«e- m efe'. r e- «e 


./• 


f i = e 


-°i-^ r I Vr m iV r V k 


f _ " 0 N“ M n' m N^N" m N^N ’ r N' %" X I e j 

j 


The corresponding densities are 


n e = 2| 



A -l/2/e- n e 


n i = w i 





"j ' "J e 


-Vj 



A -l/2 e ^N-°N 
A N e 
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(41c) 

(42a) 

(42b) 

(42c) 

(43a) 

(43b) 

(43c) 

(44a) 

(44b) 

(44c) 


I 


3/2 


(44d) 


where 


n N = 



n. = 
J 


X I E 0 



a -1/2 ^N"^N 
a N e 




r ll 

r l 2 

r l3 




A = det 

r 12 

r 22 

r 23 


(45) 



_ r 13 

r 23 

P 33_ 



, m 

P = — 

4A 

(^ 0,11 + ^22 + ^ 0,33 + 


12 + M l M 3“l3 + M 2 M 3“23) 

(46) 


where 


a kl = 


3A 


9r, 


k l 


(47) 


Arguments similar to those of cases 1 and 2 lead to the following result: 


n n. 
e i 


n 


N 





(48) 


Equation (48) is written in terms of all the Lagrange multipliers; only diffusional equi- 
librium is assumed (eq. (34a)). Simplifying relations that have not been investigated may 
exist. 


RESULTS AND DISCUSSION 

The principle of maximum entropy (disorder) has been applied to three cases of 
plasma behavior: quiescent, current carrying, and viscous. The following Saha -type 
equations were found: 
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The results of case 1 are, of course, well known. This case was presented as a 
simple illustration of the procedure used in the later sections of this report. 

Equation (39) from case 2 is plotted in figure 1. The parameter T is a dimension- 
less current, and x is the fraction ionization m/np of the gas. The intercepts are the 
normal Saha conditions (case 1) for the same temperature and density of nuclei n Q . 

The line of the electron Mach number, M = 1, drawn in figure 1 indicates that an 

C 

effective increase in fraction ionization occurs only in situations in which the directed 
energy of the electrons is a substantial fraction of the total energy. However, in such 
highly directed streams, other factors such as instabilities may contribute to modify the 
results. 

With the acknowledgment of these limitations and qualifications, it is interesting to 
examine the application of these results to cesium and argon plasmas. Figures 2(a) and 
(b) are plots of the fraction ionization as a function of the actual current density for var- 
ious initial fraction ionizations for cesium and argon, respectively. A nuclei density of 
10 20 per cubic meter is assumed in both these figures. In figure 3, the fraction ioniza- 
tion as a function of nuclei densities is compared for cesium and argon. The Saha tabu- 
lations of Drawin (ref. 11) were used to make these plots. 

The results of case 3 (viscous plasma) are cursory, and they are presented only to 
point out another possible application of the maximum entropy method. Further reduc- 
tion of this case is beyond the scope of this report. 

LIMITATIONS AND CONCLUDING REMARKS 

The primary limitation of the method presented in this report is its restriction to 
mixtures of ideal gases. Extension of the method to nonideal gases would entail an 
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entropy function that would take into account correlations among particles. 

The second limitation is the choice of auxiliary equations that enable one to find rela- 
tions among the Lagrange multipliers of each species. If there are no interactions 
between species, then there will be no relations (except accidental ones) between the 
Lagrange multipliers. The distribution functions in this case would be independent of 
each other. In a sense, the auxiliary equations are the results of interactions, and a 
rigorous treatment would demand solving for the kinetic rate processes. The choice of 
auxiliary equations used in this report are therefore subject to review in any real plasma 
problem . 

The justification for the assumption that the free and bound electrons exchange energy 
to the exclusion of electron-heavy particle interactions (and radiation losses) is based on 
previous studies. Kerrebrock (ref. 10) discusses the electron heating phenomena and the 
two -temperature plasma model. The validity limits of the Saha equation for radiationless 
plasmas are discussed by Griem (ref. 12) and also in a previous publication by the author 
of this report (ref. 13). These studies are based on the comparison of lifetimes of atomic 
states and are thus beyond the realm of thermodynamics. It is sufficient to know that 
such regimes exist. 

The study of the current-carrying plasma in case 2 is based on the same assumptions 
used for case 1. The effect of the current flow is an enhancement of Saha's equation 
(see eq. (39) and fig. 1). The current densities at which an appreciable effect occurs are 
much higher than those currents considered by other authors. For this reason, a com- 
parison of the thermodynamic result to the kinetic approach of Dugan, et al. (ref. 14) is 
not possible. Likewise, the measurements made by Solbes (ref. 15) are not of a suf- 
ficiently high current density to prove or disprove the effect. With respect to figure 1, 
it is likely that one would have to look for the effect in shock waves, in high density arcs, 
or in some other device in which the directed energy of the electrons is great. 

Lewis Research Center, 

National Aeronautics and Space Administration, 

Cleveland, Ohio, March 6, 1968, 

129-02-01-07-22. 
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Figure 3. - Comparison of cesium and argon fraction ionization as function of current density with nuclei densities 
of 10 z0 per cubic meter at initial fraction ionization of 0. 5. 
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